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Narrative  Job  Descriptions  as  Potential 
Sources  of  Job  Analysis  Ratings 


Summary 


The  present  study  investigated  whether  narrative  job  descriptions  could  be  converted  to  quantitative  rating  a -ores 
using  a  traditional  job  analysis  questionnaire.  Detailed  written  descriptions  rt  121  different'  jobs  in  a  military 
nealth  car-"  facility  were  rated  using  tho  Position  Analysis  Questionnaire  (PAQ).  Indices  of  integrator  agreement  (intra¬ 
class  correlation  coefficient  and  average  pairwise  correlation)  suggested  acceptable  levels  of  agreement  for  job  dimen¬ 
sion  stores  derived  from  th«*»e  ratings.  Further,  when  regreased  againet  General  Aptitude  Test  Battery  (GATB)  abilities 
estimates,  the  job  dimension  scoreo  produced  values  very  similar  to  those  reported  by  previous  studies  using  the  PAQ. 
*'inaliy,  clubtsr  analyses  of  the  121  jobs  suggested  that  the  dimensions  provided  a  viable  means  of  grouping  jobs  into 
families  Pctentia1  uses  for  data  derived  irom  narrative  job  descriptions  are  discussed  in  terms  of  (a)  their  appropriate- 
ruses  in  decisions  regard*  g  relatively  macro  aspects  of  the  job  and  (b)  the  savings  in  coat  and  organizations!  intrusive¬ 
ness  realized  when  such  ratings  are  used  as  an  alternative  to  ttie  detailed  analysis  of  speci5‘  *  jobs  in  many  situations. 
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Narrative  Job  Descriptions  as  Potential 
Sources  of  Job  Analysis  Ratings 

Recent  months  have  seen  a  resurgence  of  interest  in  structured  job  analysis  techniques  (Cornel¬ 
ius,  Carron,  A  Collins,  1979  ;  McCormick,  1976  ;  Pearlaan,  1900).  This  interest  is  quite  under  it  md- 
able  as  organisational  managers  and  researchero  seek  more  precise  and  objective  data  for  use  in  job 
classification  decisions,  the  development  of  selection  and  training  programs,  and  the  improvement 
of  performance  appraisal  systems.  Numerous  methods  exist  for  obtaining  detailed  job  or  task  analysis 
information,  but  virtually  al  require  a  qualified  obaerver  to  deacribe  the  proceaaes  involved  in 
accomplishing  the  job  or  to  make  a  series  of  judgments  about  a  variety  of  specific  activities  or 
behaviors  required  by  the  job  (Cornelius  &  Lyness,  1980).  This  inherent  element  of  judgment  has 
led  to  a  number  of  concerns  about  who  ia  beat  qualified  to  perform  such  ratings. 

Traditional  aources  of  job  analysis  ratings  have  included  the  incumbent,  the  immediate  supervisor, 
and  trsined  job  analysts  who  observe  selected  individuals  in  the  work  setting.  Each  of  these  sources 
has  proven  useful  but  none  ia  without  problems.  For  example,  the  supervisor  apparently  represents 
the  most  meaningful  source  of  information  about  the  behaviors  or  activities  that  should  be  performed 
on  the  job  although  the  job  incumbent  is  likely  to  be  the  most  knowledgeable  informant  about  be¬ 
haviors  that  are  actually  performed  (Greller  6  Herold,  1975).  On  the  other  hand,  the  job  incumbent 
may  lack  the  necessary  skill  or  sophistication  to  mike  accurate  dist  actions  of  the  kind  required 
by  most  job  analysis  questionnaires. 

To  some  degree,  the  questionnaires  themselves  contribute  to  these  difficulties.  Most  of  the  popu¬ 
lar  job  analysis  instruments,  especially  the  Position  Analysis  Questionnaire  (PAQ)  developed  by 
McCormick,  Jeanneret,  and  Mecham  (1972),  have  been  criticised  for  language  that  ia  too  general  and 
too  esoteric  to  be  used  by  the  average  employee  (Aah  &  Edgcll,  1975;  Levine,  Ash,  A  Bennett,  1980), 
This  complexity  of  language  has  been  blamed  for  findings  such  as  tho:’  *  reported  by  Robinson,  Wahlstrom, 
and  Mecham  (1979)  that  ratings  by  job  incumbents  were  not  as  accurate  as  those  provided  by  personnel 
department  analysts,  especially  for  blue-collar  jobs. 

In  a  related  study  Smith  and  Haknl  (1979)  used  the  PAQ  to  obtain  job  analysis  ratings  from 
job  incumbents,  supervisors,  trained  job  analysts,  and  students.  When  the  scores  obtained  from 
these  different  sources  were  compared,  it  was  found  that  job  incumbents  and  supervisors  at  the  lower 
levels  tended  to  produce  leva  reliable  ratings  than  the  other  groups  and  that  incumbenta  and  super¬ 
visors  at  all  levels  produced  ratings  that  appeared  inflated  compared  to  thooe  of  outside  observers 
and  students.  The  authors  noted,  however,  that  even  though  such  trends  gave  a  slight  edge  to  stu¬ 
dents  and  outside  observers  in  terms  of  overall  accuracy,  it  made  little  practical  difference  who 
actually  performed  the  ratings. 
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Baaed  on  evidence  that  an  individuals  lack  of  peraonal  faailiarity  with  the  work  did  not  appear  to  have  an  adverae  effect 
upon  hia  or  her  ability  to  coaiplete  the  PAQ,  Smith  and  Hakal  argued  that  if  the  purpoae  of  conducting  the  job  analysis 
waa  to  group  aimilar  occupationa  into  cluatera  or  to  claaaify  jobe,  "...  then  the  fact  that  even  lay  peraona  with  little 
contact  with  the  job  can  agree  at  extremely  h!gh  levela  with  incumbents,  supervisors,  and  analyata  ahould  be  interpreted 
aa  evidence  for  the  uaefulncar  of  the  inatruaent"  (1979,  p.  691). 

Such  concluaiona  have  potentially  far-reaching  iaplicationa  for  the  uae  of  job  analyais  inatruaenta.  Pirat,  they 
raiae  queationa  about  the  degree  to  which  aoat  of  theae  inatruaenta  are  aenaitive  enough  to  reflect  differencea  racing  jobs 
of  aimilar  typea.  Second,  they  raiae  queationa  about  the  nature  and  acope  of  information  required  to  form  valid  and  re¬ 
liable  ratinga.  Third,  they  raiae  queationa  about  the  utility  of  uaing  certain  aourcea  of  information.  In  regard  to  the 
first  of  theae  pointa,  Corneliur  et  al.  (1979)  attempted  to  diacriminatc  among  seven  foreman  joha  in  a  chemical  proceasing 
plant.  They  compared  different  job  analyaia  techniquea  that  emphaaiaed  taak-oriented ,  worker-oriented,  or  abilitiea- 
oriented  data  and  found  that  the  varioua  techniquea  led  to  different  concluaiona  about  the  degree  of  overlap  among  the 
aeven  joba.  Taak  and  ability-oriented  data  tended  to  auggeat  at  leaat  three  aeparate  cluatera  while  worker-oriented  data 
(derived  using  the  PAQ)  suggested  that  all  the  foreman  jobs  were  esaentially  identical.  The  authors  noted  that  theae  dif¬ 
ferences  were  probably  due  to  the  fact  that  the  PAQ  waa  designed  for  use  in  a  wide  variety  of  jobs  and  occupational  aet- 
tinga,  and  thus  was  not  sensitive  to  the  more  subtle  differences  that  distinguish  among  relatively  aimilar  joba. 

This  point  of  view  waa  given  greater  credence  when  Levine  et  al.  (1980)  compared  four  job  analyaia  techniquea  with 
regard  to  their  utility  for  personnel  aelection.  The  authors  found  that  the  different  methods— job  elements,  critical 
incidents,  taak  analyais,  and  tie  PAQ — produced  aelection  examination  plana  that  differed  somewhat  in  overall  quality  but 
not  in  basic  content  or  applications.  They  noted  that  differences  in  level  of  precision  and  detail  attributable  to  the 
different  job  analysis  techniquea  tended  to  be  loaf  in  aucceaaive  applications  aa  the  data  were  translated  into  a  rela¬ 
tively  restricted  set  of  alternative  examination  raethoda. 

Observations  such  aa  the  above  raise  doubts  about  the  utility  of  obtaining  information  through  detailed  observations 
of  specific  joba  when  the  primary  purpoae  of  thut  information  ia  to  draw  conclusions  or  make  decisions  about  claasea  of 
jobs.  Whether  .he  investigator  uses  trained  raters  or  job  incumbents  to  provide  such  data,  the  process  remains  a  alow, 
costly  and  disruptive  intrusion  into  the  work  environment  (Levine  et  al.,  1980;  Morsh,  1964).  This  ia  eapecially  true  for 
joba  that  occur  with  some  frequency  in  an  organisation  where  many  manhours  taay  be  required  to  rate  even  a  significant 
portion  of  the  individual  positions.  Thus,  a  leas  costly  air1  less  intrusive  means  of  providing  ...antitative,  reliable 
and  valid  information  about  classes  of  joba  would  appear  beneficial  for  many  organisational  applications,  such  as  salary 
adjustment,  job  classification,  or  other  comaorv  actions  that  depend  on  the  identification  of  genotypic  similarities  ur 
differencea. 

In  some  of  these  applications,  it  appears  that  the  utility  of  conventional  jjb  analyaia  instruments  might  be  extended 
further.  Huny  organisations  poasesa  detailed  written  descriptions  of  the  joba  performed  in  that  organisation.  Often 
theae  descriptions  were  developed  through  extensive  observations  and  analyaia.  Unfortunately,  the  utility  of  such  des¬ 
criptions  ia  restricted  because  they  do  not  provide  directly  the  quantitative  scores  that  are  necessary  for  many  of  the 
above  applications.  Thus,  a  technique  for  converting  existing  narrative  descriptions  to  standardised  job  analyaia  ratings 
without  having  to  readminiater  such  inatruaenta  on  a  position-by-position  basis  would  be  valuable  whenever  the  primary 
purpoae  of  the  information  is  to  reveal  differencea  or  similarities  among  job  catagories  rather  than  specific  positions. 

The  present  study  waa  designed  to  determine  whether  trained  raters  could  convert  such  written  job  descriptions  to 
ratings  on  a  traditional  job  analyais  question  mire.  The  PAQ  waa  selected  for  this  assessment  because  of  its  extensive 
developawnt  and  generic  language.  As  noted  by  McCormick  et  al.  (1972),  the  PAQ  was  designed  to  describe  differences  and 
similarities  among  positions  in  terms  of  gene.-el  behaviors  that  are  comon  to  all  jobs.  This  is  also  the  level  at  which 


moat  job  description!  are  written  since  they  are  generally  designed  to  assist  in  job  classification  or  in  comparing 
salary  levels  for  different  jobs. 


Sample  of  Jobs 

A  listing  was  obtained  of  all  employee  positions  and  job  titles  at  a  medium-siaed  military  hospital  employing  approxi¬ 
mately  1,100  persons.  These  individuals  represented  121  unique  job  categories  based  on  differences  in  job  title,  job 
register  code,  paygrade  range,  and  whether  or  not  the  position  was  designated  as  supervisory  in  nature.  The  inclusion  of 
the  latter  two  variables  was  necessary  because  of  explicit  differences  in  the  duties  of  positions  with  the  same  job  title 
but  at  different  paygrade*  or  different  levels  of  supervisory  responsibility  (cf.  Gottfredson,  1980). 

Task  Analysis  Procedure 

Extensive  narrative  descriptions  of  each  of  the  121  job  categories  were  obtained  from  the  U.S.  Civil  Service  Com¬ 
mission  Qualifications  Standards  (1978).  These  descriptions  contained  detailed  information  about  the  scope  of  job  duties, 
experience  and  training  requirement# ,  supervisory  controls,  and  general  work  conditions  that  are  typically  encountered  by 
individuals  in  each  category. 

Two  graduate  level  psychology  students,  trained  in  the  use  of  the  PAQ,  were  asked  to  rate  the  121  job  descriptions. 
Twenty-five  of  the  job  descriptions  were  selected  at  random  for  rating  by  two  additional  students.  Responses  were  averaged 
across  raters  and  the  resulting  job  element  ratings  were  scored  on  the  27  job  dimensions  and  5  overall  dimensions  described 
by  McCormick  et  al.  (1972). 

Interrater  Reliability 

Reliability  in  the  form  of  agreement  among  raters  was  measured  for  items  and  dimensions  by  calculating  the  intraclaaa 
correlation  coefficient  (Ebel,  1951)  and  the  average  pairwise  correlation.  The  latter  estimate  was  obtained  by  corre¬ 
lating  ratings  across  all  pairs  of  raters,  converting  the  resulting  correlations  to  a-scores  and  averaging.  The  average 
^-scores  were  then  converted  back  to  correlation  coefficients. 

Validity  of  Ratings 

The  validity  of  the  ratings  was  addressed  in  regard  to  two  issues:  (s)  correlations  with  independent  scores,  and 
(b)  the  ability  of  the  ratings  to  produce  meaningful  job  families. 

Correlational  analyses.  The  primary  assessment  of  rcting  validity  paralleled  portions  of  the  initial  efforts  to 
establish  validity  for  the  PAQ  (McCormick  et  al.,  1972).  Published  ratings  of  appropriate  worker  trait  components  were 
obtained  for  each  job  from  the  Dictionary  of  Occupational  Titles  (U.S.  Department  of  Labor,  1965).  These  ratings  cloaely 
paralleled  the  ability  requirements  of  the  General  Aptitude  Test  Battery  (GATB).  PAQ  job  distension*  were  selected  and 
regressed  against  each  of  the  GATB  abilities  areas  in  an  attempt  to  reproduce  the  multiple  regression  coefficients  re¬ 
ported  by  McCormick  et  al .  (1972). 

Job  family  analyses.  As  a  second  assessment  of  rating  validity,  job  families  were  formed  via  a  hierarchical  cluster¬ 
ing  (Ward,  1963;  Ward  6  Hook,  1963)  baaed  on  score  profiles  on  the  five  overall  dimension  scores  derived  from  the  PAQ. 


The  resulting  clusters  were  then  used  as  classification  variables  in  a  multiple  discriminant  analysis.  Classification 
functions  were  computed  and  used  to  establish  the  probability  of  membership  in  each  cluster  for  each  of  the  jobs.  As  a 
check  of  the  goodness  of  fit  for  the  initial  hierarchical  clustering  analysis,  jobs  were  reassigned  to  the  cluster  with 
the  highest  probability  of  membership. 


Interrater  Reliability 


When  indices  of  niterrater  agreemsnt  were  calculated  at  thv  item  level,  the  results  suggested  generally  low  and 
unacceptable  levels  of  agreement.  Median  val  lea  for  the  intraclass  correlation  and  the  average  pairwise  corre4ation  were 


■’\%v 


.42  and  .48,  respectively .  tnterratrr  agreement  tended  to  improve  aa  [terns  were  aggregated,  however  (See  Table  1).  For 
the  job  dimension  scores,*  the  median  int racist#  correlation  was  ,bl,  while  the  corresponding  average  pairwiie  correlation 
was  ,65.  Finally,  the  median  intraclaas  and  average  pairwise  correlations  tor  the  five  overall  job  dimensions  were  .70 


and  .83,  respect ivel/.  Because  these  latter  values  were  generally  consistent  with  thot*  reported  by  other  studio*  using 
the  PAQ  (Smith  &  Hakel ,  1979;  Taylor,  1978;  Taylor  A  Colbert,  1978),  it  was  concluded  that  the  job  dimension  and  overall 


dimension  scores  reflected  sufficient  levels  of  agreetMnt  to  justify  their  inclusion  In  further  analyses. 


Tafcla  2 

Milttplt  CortaUtlona  Sat  wean  DOT  Worker 
Trait  Component*  and  Job  Dteaotlntia 


Workmr  Trait 

Component 

P4Q 

Jab  Dlaanalona 

Multiple 

corraution 

(0) 

Intelligence 

1. 

14,  13,  14,  17,  19,  23 

.85 

(.78) 

(v> 

Verbal 

3. 

a. 

9,  14,  IS,  17,  22,  23 

.10 

(.80) 

(*) 

Numerical 

1. 

9. 

14,  IS,  14.  17,  19.  23 

.71 

(.33) 

(S) 

Spatial 

1. 

3. 

1,  14,  IS,  14,  25,  24 

.80 

(.30) 

(F) 

Fat*  Parc apt Ion 

3. 

1, 

14,  IS,  14,  17,  32 

.31 

(-42) 

(Q) 

Clarlcal  Parc apt  Ion 

3. 

4. 

8,  9,  11,  IS,  17,  22 

.74 

(.33) 

(K) 

Motor  Coordinator 

3. 

9. 

13,  14,  IS.  17,  19.  22,  25 

.43 

(.31) 

(F) 

Finger  Daxtarlty 

3. 

5. 

4,  4,  9,  13.  IS,  22 

.43 

(.44) 

oc 

Minual  Daxtarlty 

3. 

6. 

11,  12,  IS,  14,  20,  2S 

.39 

(.39) 

NOTE:  Multiple  correlation  coefficient  a  In  parenthaeea  in  reprinted  from 
McCormick  at  nl,  (1972)  and  ara  praaantad  for  canparlaon  purpoaaa. 

Validity  Eatimates 

Tcblc  2  presents  the  result*  of  the  multiplt  regreaaion  analyses  between  the  PAQ  job  dimensions  and  the  ability  re¬ 
quirements  estimates  obtained  from  the  Dictionary  of  Occupational  Titles  (DOT),  These  values  ranged  from  .59  to  .85  j 

and  were  generally  comparable  to  those  reported  by  McCormick  et  al.  (1972). 

Job  families  ■’ 

~  a 

As  an  added  aascsament  of  the  validity  of  the  joh  ratings,  the  121  jobs  ware  clutter  analysed  using  the  first  *our  ^ 

of  the  overall  job  dimensions.  The  fifth  dimension  (JO-V)  vaa  not  included  in  these  analyses  because  of  the  low  estimates  *; 

k 

of  inrerrater  agreement.  The  hierarchical  procedure  suggested  potential  solutions  of  10.  12,  or  16  clusters.  All  except  | 

the  10* r luster  solution  produced  groups  with  highly  similar  profiles  suggesting  thst  further  collapse  would  yield  a  more  t 

parsimonious  solution.  Table  j  presents  the  job  titles  organised  by  cluster  and  subcluster.  Profiles  for  tne  clusters  j 

are  presented  in  Figure  1.  Two  jobs — police  officer  and  motor  vehicle  operator — were  not  able  to  be  giouped  into  any  of  \ 

the  existing  clusters. 
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Table  3 


I  ImM  111,  lHl|M 
1  N^t  to*.  teVAMl jm 
It  ti  mm  mi  Mt,  4flUat 
44  Mac.  HMUUi 
48  Iflt,  4acafc.<  l|M 
44  •**.  4a*ly  *■*.  4*4- 
41  4****,  Mm  4  Mt.  NfUn 


4  OtoUtl  h;Mlnli 
»  ImM  Mte 


44  M«|  HmMIm 
M  MUw,  Irak.  SpaalM. 
*4  MM.  toi|W  (Mac) 
49  MU,  Mam  (MUt) 
44  Mato.  4m*. 
it  Mm  Mim 
m  iH»to«i  Uiu.  ««(im( 
114  Cmw:  UmMUUfi 
111  Tniatai  Umiwu* 

U4  Tnuih  MUtmww 

SSC  2-1 

•IMCT  MNtCAL  CAM 
M  «m-  Batata*  Caaaaltaut 
44  ill— lU 
44  Mini  MIImt 
Ml  «m  Mini  tfliw 

Ml  WtlMM  MlMM 

IM  aiim  umiatM 
144  4M  a—  tut 

IM  MUU1U 
IU  4-U  MIIim 
m  Mt.  umii  iiiiin 


mjt  m  mm 


M  4mmiIm1  to*Uk  Mm 
ll  nuiM  atm 
il  Mm  hmiiimk 
44  Cm*,  eitolMl  Mm 


41  UtUMi  4m  ItoMl  Atm 
4i  Wnia«  mm  «t 
41  UM  »TC 


i  im,  au.  i«n.  nm 
U  >m>  eia*k 

14  I pvt*  UwVtTflM 

ii  uat  mm  eu«t 

tt  am  m.  to*.  a «t 


94  Halt  Hill  CpiNM 

n  m.  ■«««  *mi»  tm. 

If  MUl  *4M*  t— aim 

it  um  an  mu 


14)  4m«9II1m1  IMmlM 
M4  Hfilul  IMatM 
it)  hftuti  aiiata  mm. 
U!  mmitUi  tMkaum 


14  Mti/rtu  cidti  m«*t 
N  mmiy/cUtu 
U  »— mm/a»  mam  *c 

tl  UM  TyftaC  TMIMI 
H  Um.  M»w.  na.'Ttoai, 

n  m«  MnM 
H  Ipn,  Mm*»  mwik 
tt  am  • — - 

II  ktl.  TmUUU* 


41  Uumu  *44  lit  Mu  laimia  mt, 

44  aamUmut  am  Uatac 

It  4m  twtM  Uniat 

II  4m4  »«nl>>  Mt.  UaUr 

14  Um  mint  4MWt 

m  Uaaa  m.  Mr.  tout 

44  Cum  nni 

41  lam 


14  am.  uai.  tan. 
n  aallaal  iaaaa4a  Clad 
41  hMimat  Cladt  MM 
41  Ltor— ry  T—k.t  mm 
4)  a&iftim  Nmml  cun 
uk  a-mr  clack 


4  Pm.  clad)  mm 
•  MUliatf  4m.  CUvkt  mm 
la  e&m 
u  cutt/mui 
u  mtmi  mm  cun 

It  MU  Clad 

I)  Uadi  at*.  Ham.  TmairiMt 
14  Qajtui  Clack 

n  Cam  Uacki  mut 

tt  Tallar 

to  am.  m.  cun.  mm 

u  Mt.  tot.  Clack  Trataaa 
It  beat  CUtua  Clavkt  mm 
44  tatatoalac  Unit  miM 
41  tacflt  CU»ki  mut 


44  cm  meat 

UMKJ 

mm  cm ut  amrntai 

44  toaaakaaciac  Mlteat 


11  TtauaeadMiaa  rataaaa 
n  Nat.  tm  total?  Uram 


tl  C 

44  C 


aim 

auciu  ncaicMi  tervtar 
4)  taalaac  act,  Tkakatal— » 
*4  tot  tout  TaatoUUa 
41  CyulaW  TaatoUUa 
M  tonal  mUtaat 
14  tatokllliaiiaa  Tactotatau 
144  Mttcal  Tattoala«lM 
144  Mmty  Cat  to  la  Ua 
114  httru,  taaltk  T— to. 


OTVCi  tot  tat  lluaa  ua*'*M  idtUiuti  tltkU  tto  la?a«r  iraaaa. 


Cluster  1  consisted  af  ”Profc*»ionil ,  Non-wedicsl"  jobs.  These  were  Job*  that  required  considerable  post-Rraduatr 
training  or  highly  specialiaed  skills  normally  obtained  in  a  professional  degree  program.  These  individuals  generally 
were  not  involved  in  the  direct  provision  of  patient  care.  The  profile  for  this  cluster  differed  from  the  standardised 
2 

mean  profile  primarily  in  terms  of  a  higher  score  on  the  dimension  reflecting  Decision-Making,  Comrnmication,  and  Social 
Responsibility. 

Cluster  2  was  entitled  ’’Administrative  Support”  and  was  comprised  of  jobr  that  were  involved  in  administering  or 
overseeing  various  subsystems  or  programs  in  the  hospital.  Technical  guidance  for  some  of  these  jobs  was  provided  by 
the  members  of  Cluster  1,  The  resulting  score  profile*  reflected  jobs  that  were  relatively  high  in  Decision-Making,  Com¬ 
munication  and  Social  Responsibility,  but  somewhat  below  the  mean  on  the  Skilled  Activities  dimension. 

Cluster  3  was  entitled  "Direct  Medical  Care”  and  encompassed  physicians,  dentists,  optometrists  and  other  profes¬ 
sionals  involved  in  direc.  patient  contact  or  specialised  care  of  a  distinctly  medical  nature.  The  profile  for  this 
group  tended  to  be  above  the  mean  on  the  Decision-Making  and  Skilled  Activities  dimensions. 

The  fourth  cluster,  "Nursing”,  represented  all  levels  of  nursing  personnel  and  was  described  by  above  average  scores 
on  Skilled  Activities  and  Equipment  Operation.  Such  a  profile  appears  anomalous  until  one  reviews  the  items  that  com¬ 
prised  the  latter  measure.  For  example,  nurses  use  a  variety  of  equipment  in  the  provision  of  care.  In  addition,  while 
items  in  the  Equipment/Vchicle  Operation  Measure  do  primarily  reflect  the  concept  implied  by  the  title,  many  of  the  same 
behaviors  are  required  to  monitor  the  patient's  condition  and  needs  or  to  provide  care.  Among  such  behaviors  are  the 
monitoring  of  sounds,  events  and  visual  signals,  estimating  the  speed  of  fluid  flow,  responsibility  for  the  safety  of 
ethers,  and  so  forth. 

The  fifth  cluster  was  entitled  "Clerical”  and  contained  all  of  the  clerical  positions.  This  cluster  evidenced  a 
relatively  flat  profile  distinguished  primarily  by  lower  than  average  scores  on  the  Decision-Making,  Comaunication  and 
Social  Responsibility  dimensions.  The  sixth  cluster— "Blue-collar  Support"— consisted  of  hourly  wage  employees  involved 
in  various  skilled  or  manual  labor  tasks,  while  Cluster  7  was  comprised  of  individuals  in  rolea  that  involved  "Blue- 
collar  Supervision."  The  profile  for  the  former  group  was  d  fined  primarily  in  te.mi  of  higher  than  average  scores  or 
the  physical  Activities  dimension,  while  the  latter  had  above  .veregc  acorns  on  both  Decision-Making  and  Physical  Ac¬ 
tivities  but  below  average  scores  on  Skilled  Activities. 

The  jobs  in  the  eighth  cluster  were  engaged  primarily  in  "Medical  Technical  Support"  and  were  distinguished  by 
above  average  scores  on  Skilled  Activities,  while  jobs  in  the  ninth  cluster  were  involved  in  "Mechanical  Operations"  and 
reported  elevated  scores  on  both  the  Skilled  Activities  and  physical  Activities  measure,.  Finally,  the  tenth  cluster  was 
entitled  "Adjunct  Medical  Support"  becauae  it  included  jobs  that  provided  technical  support  at  a  somewhat  lower  level 
of  technological  sophistication  than  the  jobs  comprising  Cluster  8.  The  near,  acore  profile  for  this  group  was  relatively 
flat. 

The  ten  clusters  ware  then  entered  into  a  multiple  discriminant  analysis.  The  resulting  discriminant  functions 
were  used  to  d,  ermine  the  probability  that  any  particular  job  was  a  member  of  each  cluster,  when  assigned  to  clusters 
on  the  basis  of  the  highest  probability  of  membership,  92X  of  the  jobs  were  correctly  classified  into  the  groups  sug¬ 
gested  by  the  hierarchical  analysis.  Thus,  the  ten-cluetev  aolution  appeared  to  represent  a  meaningful  and  reproducible 
grouping  of  jobs . 

Discussion 

The  present  study  sought  to  determine  whether  quantitative  rating*  of  job  character!. tica  could  be  derived  from 
detailed  narrative  description*  of  those  jobe.  In  general,  the  re.ult.  were  encouraging  end  suggested  that  reliable 
and  valid  acore.  could  be  obtained  from  the  written  description,  and,  further,  that  these  .cores  provided  a  viable  basis 
for  grouping  job*  into  cluster*,  or  familiee. 
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A  primary  concern  in  dot*  ouch  u  thee*  ic  the  dotrto  to  which  different  rotere  agree  upon  underlying  character¬ 
istic*  of  the  jobe  being  rated,  tn  the  preeent  study,  indicatlone  of  auch  agreeaent  acre  nixed.  At  the  iten  lav-1, 
the  indicet  were  generally  too  low  to  juetify  further  analyeie.  Thui,  the  preeent  technique  it  clearly  inappropriate 
if  one  require!  the  fine  level  of  diecriaination  normally  aitociated  with  analyeet  of  tpacific  iteat.  On  the  other  hand, 
Interrater  agreement  appeared  at  leaet  moderate  for  the  job  diaention  acorea  and  tended  to  equal  or  exceed  valuee  re¬ 
ported  in  previoua  studies  (Corneliua  at  el.,  1779;  Smith  &  Hakel,  1979;  Taylor,  1978 ;  Taylor  l  Colbert,  19?8),  Further, 
concerns  about  intevrater  agreeaent  or  reliability  were  alleviated  somewhat  by  the  magnitude  of  the  validity  coefficients 
obtained  when  PAq  diaenaion  acorea  were  regressed  against  independently  derived  eatimatea  of  worker  abilities  obtained 
from  the  Dictionary  of  Occupational  Titles. 

Potential  explanations  for  this  apparent  discrepancy  are  many,  but  perhans  the  moat  logical  reflects  the  type  of 
information  provided  by  the  job  deacriptiona  themselves,  These  descriptions  seldom  contained  the  type  of  information 
that  would  permit  explicit  ratings  of  specific  behavioral  requirements,  but  rather  described  jobs  in  teraa  of  general 
demands.  Thus,  it  appeared  that  raters  were  able  to  recogniae  and  agree  upon  general  characteriatica  of  the  job  but 
were  unable  to  extract  sufficient  specificity  from  the  descriptions  to  agree  upon  the  exact  elements  that  comprise  those 
general  characteristics,  A  potential  corollary  influence  waa  suggested  by  Jenkins  ftadler,  Lawler,  and  Caassenn  (197S) 
who  argued  that  a  lengthy  job  analyaia  questionnaire  tended  to  cause  raters  to  become  bored  and  to  lose  sight  of  the 
relationehip  between  a  particular  item  and  the  concept  it  reflecta.  The  FAQ  definitely  qualifiea  es  a  lengthy  instrument, 
so  that  in  the  process  of  rating  a  number  of  jobs,  the  ratera  may  have  used  items  in  slightly  different  ways.  The 
aggregation  of  scores  across  related  items  would  reduce  the  potential  impact  of  such  tendencies  and  would  produce  greater 


The  lack  of  agreement  for  items  argues  against  analyses  conducted  at  that  level  but  docs  not  negate  the  potential 
utility  of  scores  derived  from  those  items.  As  noted  recently  by  Ksye,  "The  reliability  that  matters  is  the  reliability 
that  will  actually  be  used  in  the  analyaia,  after  it  has  been  recoded,  transformed,  combined,  concatenated,  or  smoothed 
in  preliminery  ways"  (1980,  p.  467).  Thus,  the  level  of  interrater  agreement  appears  sufficient  if  the  ratings  are  used 
for  decisions  involving  dimension  scores  rather  than  item  scores. 

More  crucial  than  the  above  indications  of  interrater  agreement  waa  the  evidence  that  the  ensuing  dimension  scores 
represented  valid  measures  of  important  job  characteriatica.  For  example,  th-  results  of  the  multiple  regression  analyses 
paralleled  both  in  pattern  and  in  magnitude  the  findings  reported  by  McCormick  at  al.  (1972)  during  their  original  efforts 
to  validate  the  FAQ.  The  fact  that  the  FAQ  dimension  scores  used  in  the  present  study  were  derived  from  sources  and 
techniques  that  were  entiroly  independent  of  those  uaed  to  obtain  the  ability  estimates  served  ae  further  evidence  of 
validity. 

Such  evidence  of  validity  forme  a  necessary  foundation  for  the  uee  of  job  analysis  ratings  derived  from  narrative 
job  descriptions.  In  many  ways,  however,  the  results  of  the  clutter  analyses  may  have  more  far-reaching  implications. 
These  latter  results  suggested  that  the  ensuing  job  dimensions  (a)  were  relatively  eenaitive  but  robust  measures  of  es¬ 
sential  similarities  and  differences  among  the  jobe,  and  (b)  were  able  to  produce  conceptually  meaningful  clusters  of 
jobs  Equally  important  waa  the  evidence  that  the  ratings  were  eenaitive  to  differences  associated  with  job  level  es 
well  as  those  associated  with  job  type  (cf.  Gottfredaon,  1980).  For  example,  apparent  differences  in  job  requirements 
produced  separate  clusters  for  blue-collar  workara  and  blua-collar  supervisors,  and  s'vggested  distinct  subcluatars 
that  dif farad  in  maan  acorea  but  not  in  score  profile  for  clerical  pecsonnel  involved  in  designated  supervisory  roles. 

This  apparent  ability  to  classify  a  wide  range  of  positions  into  appropriate  job  families  and  subfamilies  based  on 
the  general  and  widely  available  information  presented  in  narrative  job  descriptions  provides  a  number  of  attractive  op¬ 
portunities  for  the  organisational  practitioner  or  researcher.  Aside  from  obvious  implications  for  setting  pay 


comparability  or  for  establishing  tha  ganeralisability  of  selection  and  training  program*  (cf.  Cornelius  at  al.,  1919), 
*uch  information  appear*  quite  uaeful  in  developing  comparable  performance  evaluation  instrument*  for  job*  that  posses* 
different  title*  but  which  make  similar  demand*  on  their  incumbent*.  Sue  i  acore*  may  al*o  provide  uieful  standard*  to 
evaluate  measures  of  other  organisational  condition*  such  a*  subuni^  struc  ura  or  workgroup  climate.  In  regard  to  this 
last  noint,  Jones  and  James  (1979)  noted  that  individual*  in  parallel  job*  but  in  different  organisation*  tended  to 
report  similar  climati  profile*.  Moreover,  these  similarities  were  often  greater  than  were  found  for  different  job*  in 
the  same  organisation.  Thu*,  knowledge  of  the  probable  profile  for  a  particular  job  family  would  be  a  valuable  tool 
for  person*  seeking  to  understand  or  change  key  aspect*  of  the  work  environment  to  produce  a  better  fit  with  the  job. 

A  final  note  \s  in  order.  While  the  technique  proposed  in  the  present  effort  provides  a  relatively  unobtrusive  and 
inexpensive  means  for  obtaining  quantitative  indice*  of  qonseon  job  characteristics,  the-  quality  of  the  final  product 
rests  heavily  upon  the  quality  of  the  position  descriptions  used,  To  the  degree  that  these  descriptions  lsck  sufficient 
detail,  the  rater  sill  b*  forced  to  rely  more  heavily  on  implicit  theoriea  or  atereotype*  of  the  work  conditions  being 
rated.  The  resulting  rating*  may  reflect  meaningful  distinctions  between  jobs,  but  it  appears  necessary  to  explore  ghat 
is  being  rated  by  obtaining  ratings  from  more  than  one  person,  or  by  comparing  rating*  derived  from  narrative  descrip- 
tiona  with  those  obtained  from  job  incumbents  or  in  situ  observers.  These  latter  aeta  of  ratings  could  be  few  in  number 
and  may  be  designed  to  do  little  more  than  demonstrate  the  adequacy  of  the  narrative  descriptions. 

In  suamuiry,  the  present  study  suggested  that  quantitative  job  analysia  rating*  derived  from  narrative  job  descrip¬ 
tions  provide  a  reliable  and  valid  basia  for  a  number  of  organizational  applications.  While  these  applications  appear 
most  amenable  to  decisions  involving  relatively  macro  aspects  of  the  job,  the  savings  in  cost  and  organisational  intru¬ 
siveness  suggest  that  such  ratings  may  be  attractive  alternatives  to  the  detailed  analysis  of  specific  jobs  in  many 
situations. 
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Footnotes 

*The  job  elements  in  Dimensions  JA-7,  JF-24  and  JF-27  were  highly  restricted  in  the  present  setting  and  thus  had 
insufficient  variance  for  inclusion. 

2 

To  maintain  orthogonality  of  the  factor  scores,  they  were  standardized  on  the  present  sample.  Thus,  differences 
must  be  interpreted  on  a  relative  basis.  Insofar  as  this  sample  excluded  many  blue-collar  jobs  and  overrepresented 
clerical  and  high  level  professional  jobs,  the  resulting  standardised  mean  may  be  misleading  for  comparing  jobs  from 
the  present  sample  with  jobs  drawn  from  other  samples. 
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